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DETAILED ACTION 

A request for continued examination under 37 CFR 1.114, including the fee set 
forth in 37 CFR 1 .17(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1 .17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1 .1 14. Applicant's submission filed on 
8/1/2005 has been entered. 



Response to Arguments 

Applicant's arguments filed 8/1/2005 have been fully considered but they are not 
persuasive. 

Response to Remarks: 

Applicant's arguments regarding amended claims 1,19, 37, 55, and 73 
(amendment pages 17-18) state that the Matsumoto reference does not state that 
coefficients are selected for each image based on the exposure condition of that image. 
The Examiner respectfully disagrees. Matsumoto discloses in figure 1 an imaging 
apparatus (1) including a CCD (2) capable of imaging an object at a shutter speed that 
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is different from field to field (col. 8, lines 9-1 5). Therefore, an object is sensed under 
different exposure conditions in order to acquire a plurality of images. Based on a field 
judgement signal, a digital signal produced at a first shutter speed to render a field (A) is 
output from a first selector (22) and a digital signal produced at a second shutter speed 
to render a field (B) is output from a second selector (23) (col. 8, lines 63-67). A first 
multiplier (27) and a second multiplier (28) multiply the digital image signals of 
fields (A) and (B) according to functions stored in LUTS (25,26) (col. 9, line 1 - 
col. 10, line 30). Figure 3B disclosed by Matsumoto shows the curves of two 
different weight functions (f,g) that are output to a first and second multiplier 
(27,28). The first multiplier (27) multiplies a pixel of field (A) by a cosine squared 
function and the second multiplier (28) multiplies a pixel of field (B) by a sine 
squared function (col. 9, lines 32-39). Each of these functions includes a 
correction coefficient (p) that serves to vary the weight functions (f,g) according 
to the brightness level of the different digital signals according to fields (A,B) 
(col. 7, lines 58-64). It can be seen that the weight functions (f,g) vary for each 
image based on the exposure condition (brightness level) of the image signal. 
Therefore, the Matsumoto reference still reads on the amended claims. 

Applicant's arguments regarding claims 1,19, 37, 55, and 73 (Amendment page 
18) state that the Matsumoto reference does not disclose selecting a coefficient based 
on the exposure time as required by the present claims. However, amended claims 1 , 
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19, 37, 55, and 73 only state that the coefficient is selected based on the exposure 
condition, not the exposure time, therefore this argument is moot. 

Claim Rejections - 35 USC § 102 

The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by 
another filed in the United States before the invention by the applicant for patent or (2) a patent 
granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that an international application filed under the treaty defined in section 
351(a) shall have the effects for purposes of this subsection of an application filed in the United States 
only if the international application designated the United States and was published under Article 21(2) 
of such treaty in the English language. 

Claims 1, 9, 11, 19, 27, 29, 37, 45, 47, 55, 63, 65, and 73 rejected under 35 
U.S.C. 102(e) as being anticipated by Matsumoto et al. US 6,677,992. 

Re claim 1, Matsumoto discloses in figure 1 an imaging apparatus (1) including a 
CCD (2) capable of imaging an object at a shutter speed that is different from field to 
field (col. 8 t lines 9-15). Therefore, an object is sensed under different exposure 
conditions in order to acquire a plurality of images. Based on a field judgement signal, a 
digital signal produced at a first shutter speed to render a field (A) is output from a first 
selector (22) and a digital signal produced at a second shutter speed to render a field 
(B) is output from a second selector (23) (col. 8, lines 63-67). A first multiplier (27) and 
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a second multiplier (28) multiply the digital image signals of fields (A) and (B) according 
to functions stored in LUTS (25,26) (col. 9, line 1 - col. 10, line 30). Figure 3B disclosed 
by Matsumoto shows the curves of two different weight functions (f,g) that are output to 
a first and second multiplier (27,28). The first multiplier (27) multiplies a pixel of field (A) 
by a cosine squared function and the second multiplier (28) multiplies a pixel of field (B) 
by a sine squared function (col. 9, lines 32-39). Each of these functions includes a 
correction coefficient (p) that serves to vary the weight functions (f,g) according to the 
brightness level of the different digital signals according to fields (A,B) (col. 7, lines 58- 
64). It can be seen that the weight functions (f,g) vary for each image based on the 
exposure condition (brightness level) of the image signal. Also, the correction 
coefficient (p) ensures that the sum of the weight functions (f,g) will never exceed 1 . 
According to figure 5, when a brightness level is higher than 0 and lower than ys1 , the 
weight (f) for field (A) is larger and the weight (g) for field (B) is smaller (col. 10, lines 4- 
11). Similarly, when a brightness level is higher than ys1 the weight (f) for field (A) is 
lower and the weight (g) for field (B) is higher (col. 10, lines 12-16). It can be seen that 
when the weight functions (f,g) are applied to the digital signals (x1 ,x2) they will serve to 
decrease the pixel level as long as either (f) or (g) is not 1 (figure 5). Therefore, since 
the weight functions are less than 1 the weighted (compensated) image signal (x1 * 
cos 2 (px) for field (A); x2 * sin 2 (px) for field (B)) will be less than the original image 
signals (x1 ,x2). Thus, the weighting functions (f,g) are applied to the image signals of 
each field (A,B) a positive value compensation amount is subtracted from the pixel level 
of each of the plurality of images (x1,x2) to produce a compensated image (x1 * 
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cos 2 (px) for field (A); x2 * sin 2 (px) for field (B)). The compensated images are then 
synthesized in order to produce a single synthetic image having a wide dynamic range 
(col. 10, lines 30-42). When the sum of coefficients (f,g) exceeds 1 a compression 
circuit is installed to produce a compressed image (col. 10, lines 33-42). Therefore, 
depending on the performance of the output destination the synthetic image is 
compressed to produce a compressed image. 

Re claim 9, each of the images disclosed by Matsumoto includes brightness 
signals (y,ys1,etc.) and color signals (R,G,B) (col. 8, lines 44- col. 9, line 27; co. 11, 
lines 55-65). The brightness signals and color signals are separated and the brightness 
and color signals are compensated according to claims 1 and 2 above (col. 1 1 , lines 55- 
65). The steps according to claims 1 and 2 are performed for the red, blue, and green 
dynamic range expanding circuits (15R, 15B, 15G) (col. 9, lines 52-55). Therefore, the 
compensated brightness and color signals are synthesized and compressed according 
to the same procedures as described in claims 1 and 2 above. 

Re claim 1 1, a synthetic picture signal including both brightness and color signals 
using the techniques disclosed in claims 1 and 2 (col. 10, lines 23-32). If the level of the 
synthetic picture signal exceeds the saturation value, a compression circuit is installed 
(col. 10, lines 33-42). Therefore, the synthetic picture signal is a mixed signal including 
compressed brightness and color signals. 
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Re claim 19, 37, and 55, see claim 1. 
Re claims 27, 45, and 63, see claim 9. 
Re claims 29, 47, and 65, see claim 1 1 . 

Re claim 73, Matsumoto discloses in figure 1 an imaging apparatus (1) including 
a CCD (2) capable of imaging an object at a shutter speed that is different from field to 
field (col. 8, lines 9-15). Therefore, an object is sensed under different exposure 
conditions in order to acquire a plurality of images. Plural images are synthesized in 
order to produce a single synthetic image having a wide dynamic range (col. 10, lines 
30-42). When the sum of coefficients (f,g) exceeds 1 a compression circuit is installed 
to produce a compressed image (col. 10, lines 33-42). Therefore, depending on the 
performance of the output destination the synthetic image is compressed to produce a 
compressed image. Based on a field judgement signal, a digital signal produced at a 
first shutter speed to render a field (A) is output from a first selector (22) and a digital 
signal produced at a second shutter speed to render a field (B) is output from a second 
selector (23) (col. 8, lines 63-67). A first multiplier (27) and a second multiplier (28) 
multiply the digital image signals of fields (A) and (B) according to functions stored in 
LUTS (25,26) (col. 9, line 1 - col. 10, line 30). Figure 3B disclosed by Matsumoto 
shows the curves of two different weight functions (f,g) that are output to a first and 
second multiplier (27,28). The first multiplier (27) multiplies a pixel of field (A) by a 
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cosine squared function and the second multiplier (28) multiplies a pixel of field (B) by a 
sine squared function (col. 9, lines 32-39). Each of these functions includes a correction 
coefficient (p) that serves to vary the weight functions (f,g) according to the brightness 
level of the different digital signals according to fields (A,B) (col. 7, lines 58-64). It can 
be seen that the weight functions (f,g) vary for each image based on the exposure 
condition (brightness level) of the image signal. Also, the correction coefficient (p) 
ensures that the sum of the weight functions (f,g) will never exceed 1 . According to 
figure 5, when a brightness level is higher than 0 and lower than ys1 , the weight (f) for 
field (A) is larger and the weight (g) for field (B) is smaller (col. 10, lines 4-11). Similarly, 
when a brightness level is higher than ys1 the weight (f) for field (A) is lower and the 
weight (g) for field (B) is higher (col. 10, lines 12-16). It can be seen that when the 
weight functions (f,g) are applied to the digital signals (x1 ,x2) they will serve to decrease 
the pixel level as long as either (f) or (g) is not 1 (figure 5). Therefore, since the weight 
functions are less than 1 the weighted (compensated) image signal (x1 * cos 2 (px) for 
field (A); x2 * sin 2 (px) for field (B)) will be less than the original image signals (x1 ,x2). 
Thus, the weighting functions (f,g) are applied to the image signals of each field (A f B) a 
positive value compensation amount is subtracted from the pixel level of each of the 
plurality of images (x1 ,x2) to produce a compensated image (x1 * cos 2 (px) for field (A); 
x2*sin 2 (px) for field (B)). 



Claim Rejections - 35 USC § 103 
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The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

Claims 3-5, 21-23, 39-41, and 57-59 rejected under 35 U.S.C. 103(a) as being 
unpatentable over Matsumoto in view of Fukuda et al. US 6,278,490. 

Re claim 3, Matsumoto discloses all of the limitations of claim 2 above. In 
addition, Matsumoto states that image signals (x1a,x2a) corresponding to fields A and 
B respectively are multiplied by weight functions (f=cos 2 (px) for field (A); g=sin 2 (px) for 
field (B)) (col. 9, lines 24-50). A signal (x) of the weight functions (f,g) is multiplied by a 
correction coefficient (p) according to the brightness level and exposure time of an 
image signal (col. 7, lines 49-64). Therefore, a pixel value (x1a,x2a) is multiplied by a 
factor (f,g) that is set based on the exposure condition of an image signal in order to 
calculate a positive value (x1a * cos 2 (px) for field (A); x2a * sin 2 (px) for field (B). As 
shown in figure 5, image signals (x1a) and (x2a) always have a positive value and the 
sum of weight functions (f,g) must always be 1 (col. 10, lines 33-34). Thus, (x1a * 
cos 2 (px) for field (A); x2a * sin 2 (px) for field (B)) are always positive values that are less 
than the original image signals (x1a and x2a). Although Matsumoto discloses all of the 
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limitations above, he fails to distinctly state that a mean pixel value of each of the 
images is calculated. 

Fukuda discloses in figure 8 an image pickup apparatus that includes a detection 
circuit (23) that detects variations in light emission amount from image data of two 
frames with different exposure amounts and a correction circuit (24) that corrects image 
data on the basis of a signal obtained by the detection circuit (23) (col. 12, lines 26-35). 
The detection circuit (23) calculates the average values of image data of signals having 
different exposure times (col. 12, lines 36-48). Therefore, it would have been obvious 
for one skilled in the art to have been motivated to include the detection circuit (23) 
capable of calculating the average values of image data of signals having different 
exposure times as disclosed by Fukuda in the imaging apparatus capable of multiplying 
image signals by weight functions (f,g) as disclosed by Matsumoto. Doing so would 
provide a means for calculating average values of image data for short and long 
exposure periods and using the calculated average values to manipulate the image data 
(Fukuda: col. 12, lines 36-48). 

Re claim 4, the positive values (x1a * cos 2 (px) for field (A); x2a * sin 2 (px) for field 
(B)) disclosed by Matsumoto are time-smoothed because they include cosine and sine 
functions (see figures 3B and 5). As shown in figure 5, image signals (x1a) and (x2a) 
always have a positive value and the sum of weight functions (f,g) must always be 1 
(col. 10, lines 33-34). Therefore, when the weight functions (f,g) are each equal to (0.5), 
the positive values (x1a * cos 2 (px) for field (A); x2a * sin 2 (px) for field (B)) are each 
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equal to one-half of the original image signals (x1a, x2a). Thus, it can be seen that 
when the weight functions (f,g) are each equal to (0.5), subracting the time smoothed 
positive values (x1a * cos 2 (px) for field (A); x2a * sin 2 (px) for field (B)) from the original 
image signals (x1a, x2a) yields the same result as multiplying the original image signals 
(x1a, x2a) by weight functions (f,g). 

Re claim 5, A signal (x) of the weight functions (f,g) is multiplied by a correction 
coefficient (p) according to the brightness level and exposure time of an image signal 
(col. 7, lines 49-64). Therefore, a pixel value (x1a,x2a) is multiplied by a factor (f,g) that 
is set based on the exposure condition of an image signal in order to calculate a positive 
value (x1a * cos 2 (px) for field (A); x2a * sin 2 (px) for field (B). As shown in figure 5, 
image signals (x1a) and (x2a) always have a positive value and the sum of weight 
functions (f,g) must always be 1 (col. 10, lines 33-34). Fields (A) and (B) represent 
images with different exposure times (col. 8, lines 63-67). As shown in figure 5, 
depending on the brightness level the weight functions or factors (f,g) are varied. When 
a brightness level is higher than 0 and lower than ys1 , the weigt (f) for field (A) is larger 
and the weight (g) for field (B) is smaller (col. 10, lines 1-11). Similarly, when a 
brightness level is higher than ys1 , the weight (f) for field (A) is smaller and the weight 
(g) for field (B) is larger (col. 10, lines 12-22). Therefore, it can be seen that depending 
on the brightness level the factor (f or g) is set larger for the image (A or B) having been 
sensed with a larger exposure. 
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Re claims 21 , 39, and 57, see claim 3. 
Re claims 22, 40, and 58, see claim 4. 
Re claims 23, 41 , and 59, see claim 5. 

Claims 6-8, 24-26, 42-44, and 60-62 rejected under 35 U.S.C. 103(a) as being 
unpatentable over Matsumoto in view of Sanner US 4,757,386. 

Re claim 6, Matsumoto discloses all of the limitations of claim 2 above. In 
addition, Matsumoto states that image signals (x1a,x2a) corresponding to fields A and 
B respectively are multiplied by weight functions (f=cos 2 (px) for field (A); g=sin 2 (px) for 
field (B)) (col. 9, lines 24-50). A signal (x) of the weight functions (f,g) is multiplied by a 
correction coefficient (p) according to the brightness level and exposure time of an 
image signal (col. 7, lines 49-64). Therefore, a pixel value (x1a,x2a) is multiplied by a 
factor (f,g) that is set based on the exposure condition of an image signal in order to 
calculate a positive value (x1a * cos 2 (px) for field (A); x2a * sin 2 (px) for field (B). As 
shown in figure 5, image signals (x1a) and (x2a) always have a positive value and the 
sum of weight functions (f,g) must always be 1 (col. 10, lines 33-34). Thus, (x1a * 
cos 2 (px) for field (A); x2a * sin 2 (px) for field (B)) are always positive values that are less 
than the original image signals (x1a and x2a). Although Matsumoto discloses all of the 
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limitations above, he fails to distinctly state that the signal each of the images is filtered 
by a low-pass filter. 

Sanner discloses in figure 1 video processor including an image sensor (12) with 
two output channels (14,16). Low-pass filters (22,26) are included in order to contain 
the modulation frequencies of the two channels (14,16) (col. 2, line 65 - col. 3, line 9). 
The pixels from each of the output channels (14,16) that are filtered by the low-pass 
filters (22,26) are finally combined by a multiplexer (40) to combine the pixels from each 
of the channels (14,16) into a single output (col. 3, line 63- col. 4, line 4). Therefore, it 
would have been obvious for one skilled in the art to have been motivated to include the 
low-pass filters (22,26) capable of containing the modulation frequencies of the two 
channels (14,16) as disclosed by Sanner in the imaging apparatus capable of 
multiplying image signals by weight functions (f,g) as disclosed by Matsumoto. Doing 
so would provide a means for filtering image signals of different channels in order to 
contain the modulation frequencies of the two channels (col. 2, line 65 - col. 3, line 9). 

Re claim 7, the positive values (x1a * cos 2 (px) for field (A); x2a * sin 2 (px) for field 
(B)) disclosed by Matsumoto are time-smoothed because they include cosine and sine 
functions (see figures 3B and 5). As shown in figure 5, image signals (x1a) and (x2a) 
always have a positive value and the sum of weight functions (f,g) must always be 1 
(col. 10, lines 33-34). Therefore, when the weight functions (f,g) are each equal to (0.5), 
the positive values (x1a * cos 2 (px) for field (A); x2a * sin 2 (px) for field (B)) are each 
equal to one-half of the original image signals (x1a, x2a). Thus, it can be seen that 
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when the weight functions (f f g) are each equal to (0.5), subracting the time smoothed 
positive values (x1a * cos 2 (px) for field (A); x2a * sin 2 (px) for field (B)) from the original 
image signals (x1a, x2a) yields the same result as multiplying the original image signals 
(x1a, x2a) by weight functions (f,g). 

Re claim 8, A signal (x) of the weight functions (f,g) is multiplied by a correction 
coefficient (p) according to the brightness level and exposure time of an image signal 
(col. 7, lines 49-64). Therefore, a pixel value (x1a,x2a) is multiplied by a factor (f t g) that 
is set based on the exposure condition of an image signal in order to calculate a positive 
value (x1a * cos 2 (px) for field (A); x2a * sin 2 (px) for field (B). As shown in figure 5, 
image signals (x1a) and (x2a) always have a positive value and the sum of weight 
functions (f,g) must always be 1 (col. 10, lines 33-34). Fields (A) and (B) represent 
images with different exposure times (col. 8, lines 63-67). As shown in figure 5, 
depending on the brightness level the weight functions or factors (f,g) are varied. When 
a brightness level is higher than 0 and lower than ys1 , the weigt (f) for field (A) is larger 
and the weight (g) for field (B) is smaller (col. 10, lines 1-11). Similarly, when a 
brightness level is higher than ys1 , the weight (f) for field (A) is smaller and the weight 
(g) for field (B) is larger (col. 10, lines 12-22). Therefore, it can be seen that depending 
on the brightness level the factor (f or g) is set larger for the image (A or B) having been 
sensed with a larger exposure. 



Re claims 24, 42, and 60, see claim 6. 
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Re claims 25, 43, and 61 , see claim 7. 
Re claims 26, 44, and 62, see claim 8. 
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Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Kelly L. Jerabek whose telephone number is (571) 272- 
7312. The examiner can normally be reached on Monday - Friday (8:00 AM - 5:00 PM). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Ngoc Yen Vu can be reached on (571) 272-7320. The fax phone number for 
submitting all Official communications is 703-872-9306. The fax phone number for 
submitting informal communications such as drafts, proposed amendments, etc., may 
be faxed directly to the Examiner at (571) 273-7312. 
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published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 
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